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preface 


This  report  documents  work  on  USAFETAC  Project  9(K)81 10,  "Chinook  Wind  Study  "  The  study  was  undertaken  at 
the  request  of  Detachment  5,  9th  Weather  Squadron,  at  Malmsirom  AFB,  MT  Project  analyst  was  Capt  Gregory  J. 
Reding,  USAFETAC/DNO. 

In  an  attempt  to  improve  its  wind  forecasting  capability.  Dot  5  had  studied  relationships  among  weather  variables 
that  might  help  forecast  high  winds  associated  with  Chinook  conditions.  The  Det  5  study  indicated  possible 
relationships  between  the  following  paired  variables:  (I)  sca-lcvel  pressure  differences  and  upper-air  wind  speed, 
(2)  sea  level  pressure  differences  and  surface  wind  speeds,  and  (3)  upper-air  wind  speeds  and  surface  wind  speeds. 

USAFETAC/DNO  was  tasked  to  study  and  verify  these  relationships.  The  results  were  negative,  there  was  not 
enough  correlation  among  variables  to  nrndtice  a  nre/lictiv''  equation.  They  '.ve.'C  also  asked  tc  ..ee  if  d:erc  wae  a 
lavored  time  interval  between  (1)  development  of  a  lO-mb  sea-lcvcl  pressure  difference  between  Boise,  ID,  and 
Malmstrom  AFB,  and  (2)  the  onset  of  23-knot  winds  at  Malmstrom.  There  was  none. 
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1.  INTRODUCTION. 


1.1  Overview.  To  improve  its  wind  forecasting  support  to  the  301st  Air  Refueling  Wing,  Detachment  5,  9WS, 
asked  USAFETAC  to  evaluate  relationships  (determined  in  a  study  of  their  own)  among  upper-air  wind  speeds, 
sea-level  pressure  differences,  and  surface  wind  speeds  at  Malmstrom  AFB,  MT.  Specifically,  Dei  5  asked 
USAFETAC  to  compute  the  correlations  between;  (1)  upper-air  wind  speed  and  sea-level  pressure  difference,  (2) 
sea-level  pressure  difference  and  surface  wind  speed,  and  (3)  upper-air  wind  speed  and  surface  wind  speed.  Further, 
if  USAFETAC’s  correlations  indicated  a  relationship  between  these  variables,  a  predictive  equation  for  each 
dependent  variable  was  to  be  developed.  An  independent  dataset  was  used  to  compute  Heidke  skill  scores  for  these 
equations.  Finally,  Del  5  asked  USAFETAC  to  investigate  the  possibliiy  of  a  predictable  lime  interval  between 
establishment  of  a  10-mb  sea  level  pressure  difference  between  Boise,  ID,  and  Malmstrom  AFB,  and  the  onset  of 
gusty  winds  at  Malmstrom  AFB. 

1.2  Report  Contents.  This  report  describes  the  USAFETAC-deiermincd  correlations  between  the  variables 
requested,  equations  derived  to  predict  the  each  dependent  variable,  Heidke  skill  scores,  and  USAFETAC’s  attempts 
to  improve  those  skill  scores.  It  al.so  describes  the  results  of  an  investigation  into  forecasting  the  onset  of  gusty 
winds. 
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2.  DATA. 


2.1  "Gusty  Winds"  Defined.  Del  5  defines  "gusly  winds"  as  gusts  of  25  knots  or  greater.  They  will  be 
expressed  that  way  throughout  the  report. 

2.2  Data  Locations.  Weather  data  came  from  the  three  stations  selected  by  Det  5;  they  are  listed  in  Table  1 . 

TABLE  1.  Weather  Stations  and  Types  of  Weather  Data  Used. 


Station 

Block  Station 
Number 

Latitude 

Longitude 

Elevation 

(meters) 

Observation 

Type 

Malmstrom  AFB,  MT 

727775 

47“30’  N 

iinr  W 

1,075 

surface 

Great  Falls,  MT 

727750 

AT29'  N 

lir22’  W 

1.115 

upper-air 

Boise,  ID 

726810 

43‘’34’  N 

116"13’ W 

874 

surface 

2.3  Period  of  Record  (POR).  This  study  used  a  16-year  POR  (1973-88)  for  each  station. 

2.4  Data  Content  and  Software.  Weather  observations  from  individual  stations  were  merged  by  common 
values  of  year,  month,  day,  and  hour  to  create  one  large  dataset  that  included  the  following  information: 

a.  Year  (2-digit:  e.g.,  78) 

b.  Month  (2 -digit;  e.g.,  01) 

c.  Day  (2-digit;  e.g.,  12) 

d.  Hour  (2-digit:  e.g.,  23) 

e  Boise  station  elevation  (meters) 

f.  Boise  sea  level  pressure  (mb) 

g.  Great  Falls  station  elevation  (meters) 

h.  Height  of  maximum  wind  speed  below  8,000  ft  MSL  at  Great  Falls  (feel) 

i.  Direction  of  maximum  wind  below  8,000  ft  MSL  at  Great  Falls  (degrees) 

j.  Speed  of  maximum  wind  below  8,000  ft  MSL  at  Great  Falls  (knots) 

k.  Showalter  Stability  Index  at  Great  Falls  (dimensionless) 

l.  SWEAT  index  at  Great  Falls  (dimensionless) 

m.  Malmstrom  station  elevation  (meters) 

"..  Malmstrom  sea  level  pressure  (mb) 
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o.  Malmstrom  wind  speed  (knots) 

p.  Malmstrom  wind  direction  (degrees) 


q,  Malmstrom  wind  gust  (knots) 

r.  Malmstrom  present  weather  codes  WWI ,  WW2.  WW^,  WVV4  (dimensionless) 

All  statistical  analyses  in  this  project  were  perlonned  with  Statistical  Analysis  System  (SAS)®>  softviarc.  SAS  is  a 
fourth-generation  language  and  statistics  system  used  at  US/\FETAC.  All  computations  ol  correlation  coellicicnts 
and  linear  regression  parameters  were  done  with  SAS  prtKedures  specitic  to  those  purposes.  Computation  ol  Heidke 
skill  scores  was  done  with  SAS  software  written  at  USAFETAC  by  Maj  Walter  F.  Miller.  CSAFE  FAC/DNO.  The 
weather  data  used  was  read  from  tape  and  stored  on  disk  in  SAS  permanent  dataset  (ormat,  which  is  particular  to 
SAS  software.  Observations  from  I97.f  to  1986  were  u.sed  as  the  dc|>endcnt  data  set  from  which  correlations  and 
predictive  equations  were  developed.  TTose  from  1987  and  1988  made  up  the  itidependent  data  set  used  to  compute 
the  Heidke  skill  scores. 


2.5  Tailoring  the  Database.  To  isolate  observations  of  high  winds  at  Malmsu^om  AFB  thought  K'  he  caused  by 
Chintwk  conditions,  the  following  data  was  deleted  from  the  database. 


2.5.1  Det  .S  asked  that  correlations  and  predictive  equations  be  developed  only  for  observations  in  which  the 
sea-lcvel  pressure  difference  between  Boise  and  Malmstrom  AFB  was  .5  mb  or  greater.  All  observations  in  which 
this  pressure  difference  fell  below'  that  threshold  were  written  to  a  separate  data  file  for  lurther  use  and  deleted  (rom 
the  original  database.  USAFETAC  u.sed  the  separatewi  data  to  produce  correlations  of  the  same  vcu'iablcs  when  the 
pressure  difference  was  less  than  .‘i  mb  to  see  whether  forecasting  .skill  was  sensitive  to  this  threshold. 


2.5.2  Because  Det  .‘i  declared  the  months  of  October  through  April 
this  period:  observations  from  other  months  were  deleted. 


"Chinook  scastm."  the  sttidv  incused  onlv  on 


2.5.3  To  eliminate  wind  gusts  cau.sed  by  synoptic  disturbances,  observations  containing  wind  directions  with  an 
ca.st'’''iv  component  were  deleted.  Westerly  gusts  associated  with  synoptic  disturbances  such  as  Irontal  passages 
could  not  be  filtered  out. 


2.5.^  Observations  containing  reports  of  convective  weather  that  could  produce  surlace  gusts  were  also  dcicled. 
The  deleted  observations  included  those  containing  pre.scnl  weather  codes  of  1 7.  1 8.  lO.  (thunderstorm  squall  and 
funnel  cloud  with  no  precipitation  at  the  ob.servation  liiue.  rc.spcctive'y)  and  80  through  99  (rain  showers,  snow 
showers,  or  thunderstorms  of  varying  intensity). 
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3.  CORRELATION  STUDIES. 


3.1  Variables.  Det  5  rci|uesicd  that  USAFEl'AC  coinpuic  corrclaiums  bolwccn  ihc  lollowing  pairs  of  variables  in 
the  dependent  dataset  diat  meet  ibe  criteria  in  2.5,  above. 

•Ma.ximum  wind  speed  below^  8,()()l)  leet  above  mean  sea  level  (MSL, >  at  Clreat  Falls.  MT,  and 
the  sea-level  pressure  dillerence  between  Boise  and  Malmstrom. 

•Observations  ol  maximum  hourly  surface  w  ind  s|X'cd  at  Malmstrom  and  the  sea-level  pressure 
difference  between  Boise  and  Malmstrom. 

•Maximum  wind  speed  tx'low  8,(KK)  feet  MSL  at  Great  Falls  and  surface  wind  s[x’ed  at 
Malmstrom. 

3.2  Correlation  Coefficients  and  Scatter  Plots.  Correlation  can  be  used  to  measure  the  strength  of  a  linear 
relationship  between  twn  variables  (  Iman  and  Conover,  198,5).  Its  value  tends  toward  7cro  if  there  is  no  tendency  for 
one  viu'iable  to  increase  or  decreiise  as  the  other  variable  increases  or  decreases.  The  correlation  ctx'fficient  always 
holds  a  value  between  -i-l  for  perfect  correlation,  and  -1  for  perfect  inverse  correlation.  A  scatter  plot  describes 
visually  how  the  variables  relate  to  each  other.  Values  of  one  of  the  vtiriates  are  listed  in  ascending  order  Irom  left 
to  right  along  the  bottom  axis  of  a  graph,  and  values  of  the  other  variate  arc  listed  from  lowest  to  highest  along  the 
left-hand  vertical  axis.  Values  ol  these  variahli  s  from  each  observation  arc  plotted  as  ctxvrdmate  pairs  on  this  graph. 
The  pattern  that  emerges  from  a  large  number  of  plotted  points  depicts  the  correlation  between  the  v  ariables.  If  the 
points  fall  along  an  upward-  or  downward-.vloping  straight  line,  the  correlation  between  the  variables  approaches  +1 
or  - 1 ,  respectively.  Points  that  are  "clumped"  together  in  no  apparent  linear  pattern  describe  a  correlation  ctx'l  ficient 
natr  7cro-thcrc  is  no  linear  relationship.  Correlation  cocfficieiiLs  and  scatter  plots  arc  used  in  .5..C  and  .T5  to 
show  how  the  requested  variables  relate  to  each  other. 

3.3  Correlation  of  Upper-Air  Wind  Speed  and  Sea-Level  Pressure  Difference.  For  this  correlation, 
only  observations  valid  at  OOZ  and  I2Z  were  used,  since  these  are  the  only  valid  times  iT  the  upper-air  observations. 
Figures  la  &  b  are  scatter  plots  ol  the  correlated  variables;  Figure  la  involves  observations  for  which  the  pressure 
difference  was  greater  than  or  equal  to  5  mb.  and  Figure  I b  covers  those  for  pressure  differences  ol  less  than  5  mb. 

SAS  computed  Pearson’s  Partial  Correlation  for  these  variables.  Partial  correlation  coellicicnts  are  used  vvhen  more 
than  tw'o  variates  are  involved  in  a  comparison,  and  when  we  want  to  isolate  the  relationship  between  onlv  twii  ol 
those  variates.  This  rejxxt  compares  only  two  variates,  and  the  partial  correlation  is  the  correlation  between  the  two 
variables.  In  this  situation,  the  correlation  ctKilicients  are: 

•  Pressure  difference  5  mb  or  greater;  ().51 

•  Pressure  difference  less  than  5  mb:  0.54 

This  indicates  that  there  is  some  linear  correlation  between  the  sea-level  pressure  dillerence  and  maximum  upper-air 
wind  speed  in  both  cases,  slightly  more  if  the  pressure  gradient  is  5  mb  or  greater.  The  scatter  plots  bear  this  out 
somewhat.  The  plotted  points  arc  arranged  roughly  along  a  straight  line  if  the  pressure  difference  is  5  mb  or  greater, 
but  they  show  significantly  less  orgaiii/ation  to  go  along  w  ith  the  lower  correlation  ctx'fficient. 

3.4  Correlation  of  Sea-Level  Pressure  Difference  and  Surface  Wind  Speed.  From  the  dauibase 
constructed  above,  the  maximum  value  of  wind  speed  or  wind  gust  in  an  hour  was  identified  as  the  maximum 
hourly  wind  sjx'cd .  "  This  variable  was  then  correlated  with  hourly  values  of  the  sea-level  pressure  dilferencc 
Iretween  Boise  and  Malmstrom.  Figures  2a<%b  show  the  scatter  plots  for  these  correlations. 
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Figure  la.  Scatter  plots  of  maximum  upper-air  wind  speed  hclow  8,000  feet  MSI.  c.v.  sea-level  pressure 
difference  between  Boise  and  Malmstrom  for  observations  in  which  the  pressure  difference  is  greater  than  or 
equal  to  5  mb.  The  Idler  A  rcprcsenls  one  ohservniioii  al  a  coordinaie  pair;  B  represents  two  olrservalimis  al  lliai 
location,  and  so  on. 
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f'igure  Ih.  Scatter  plots  of  maximum  upper-air  wind  speed  below  H.OOO  feet  MSI.  vs.  sea-level  pressure 
difference  between  Boise  and  Malmstrom  for  observations  in  which  the  pressure  difference  is  less  than  5  mb. 
The  Idler  A  represenis  one  olrser\;itinn  :u  a  coordinate  pair;  B  rcprescnls  iwo  obscrvalions  at  that  loealioii,  and  so 
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Figure  2a.  Scatter  plots  of  sea-level  pressure  difference  between  Boise  and  Malmstrom  vs.  maximum  hourly 
wind  speed  for  observations  in  which  the  pressure  difference  is  greater  than  or  equal  to  5  mb.  The  Idler  A 
reprc.scnls  one  observniion  nl  n  coonlinjile  pair;  B  reprc.senls  iwo  observations  ai  that  location,  and  so  on. 
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Figure  3a.  Scalier  plots  of  maximum  upper-air  wind  speed  below  8,000 feet  MSI.  at  007.  and  127.  w.  the  highest 
value  of  maximum  hourly  wind  speed  in  the  12  hours  following  a  sounding  for  observations  in  which  the 
pressure  difference  is  greater  than  or  egual  to  .3  mb.  The  loiter  A  rcprcscnls  one  observation  at  a  coordinate  pair,  B 
represents  two  observations  at  that  location,  and  so  on. 
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obscrvaiions  ai  lhal  l(x;alion,  and  so  on. 


3.4  Correlation  of  Sea-Level  Pressure  Difference  and  Surface  Wind  Speed.  From  ihc  daiabasc 
constructed  above,  the  maximum  value  of  wind  speed  or  wind  gust  in  an  hour  was  identified  as  the  "maximum 
houriy  wind  speed.”  This  variable  was  then  correlated  with  hourly  values  of  the  sca-levcl  pressure  difference 
between  Boise  and  Malmslrom.  Figures  2a&b  show  the  scatter  plots  for  these  correlations. 

The  correlation  coefficients  are  somewhat  lower  for  these  variates: 

•  Pressure  difference  5  mb  or  greater;  0.44 

•  Pressure  difference  less  than  5  mb;  0.23 

The  associated  scatter  plots,  likewise,  show  much  less  Foear  structure,  but  slight  organization  is  evident.  It  appears 
that  sea-level  pressure  difference  and  maximum  hourly  wind  speed  are  not  linearly  correlated  as  well  as  the  previous 
variables. 

3.5  Correlation  of  Maximum  Upper-Air  Wind  Speed  Below  8,000  Feet  MSL  and  Maximum  Hourly 
Surface  Wind  Speed.  Upper-air  observations  valid  at  OOZ  and  12Z  were  correlated  with  the  highest  value  of 
maximum  hourly  surface  wind  speed  that  occurred  in  the  12  hours  subsequent  to  the  upper-air  sounding.  Figure  3 
shows  the  scatter  plots  for  those  observations  in  which  the  sea  level  pressure  difference  was  5  mb  or  greater,  and  less 
than  5  mb. 

These  variates  are  more  highly  correlated  than  any  other  in  this  study. 

a.  Pressure  difference  5  mb  or  greater:  0.65 

b.  Pressure  difference  less  than  5  mb:  0.61 

The  scatter  plots  show  a  definite  linear  relationship,  indicating  a  good  positive  correlation  between  upper-air  and 
surface  wind  speeds. 

3.6  Sensitivity  to  the  5-mb  Threshold.  Correlation  coefficients  for  ob.servalions  in  which  the  sca-levcl 
pressure  difference  between  Boi.se  and  Malmstrom  is  5  mb  or  greater  are  always  higher  than  if  the  pressure 
difference  is  less  than  5  mb,  but  not  significantly  so.  The  variates  show  only  slightly  more  linear  relationship  if  the 
sea-level  pressure  difference  is  greater  than  or  equal  to  5  mb.  This  threshold,  therefore,  may  not  be  useful  for 
forecasting  wind  speeds. 


11 


4.  PREDICTIVE  EQUATIONS  AND  LINEAR  REGRESSION. 


4.1  Predictive  Equations.  Det  5  had  asked  that,  if  any  of  the  correlations  above  indicated  promise  of  a 
relationship,  USAFETAC  would  provide  equations  to  predict  the  value  of  one  variate  based  on  the  value  of  the 
other.  Since  the  combinations  of  variables  showed  at  least  some  linear  correlation,  predictive  equations  were 
developed  for  each,  using  a  statistical  technique  called  linear  regression.  Note  that  these  equations  do  not  forecast  a 
variable’s  value  at  some  future  time  based  on  current  data,  but  only  determine  the  c.xpected  value  of  the  dependent 
variable  at  the  time  of  the  independent  variable,  based  on  a  predetermined  model. 

4.2  Linear  Regression.  To  predict  the  value  of  one  of  the  variates  (called  the  prcdictand,  denoted  y)  on  Lbc  basis 
of  the  value  of  the  other  variate  (called  the  predictor,  denoted  x),  a  linear  relationship  could  be  assumed  to  exist 
between  the  two,  of  the  form 


y  =  a  +  bx 


(1) 


where 


a  =  the  y-axis  intercept  of  a  line  on  a  graph 
b  =  the  slope  of  a  line  on  a  graph 

The  terms  predictand  and  predictor  are  used  in  this  discussion  even  though  they  do  not  relate  to  the  forecasting  of  a 
future  event,  as  described  above.  A  best-fit  straight  line  corresponding  to  this  equation  may  be  drawn  through  the 
points  on  the  plot  such  that  the  sum  of  the  squares  of  the  deviations  from  the  plotted  points  to  the  line  is  at  a 
minimum.  This  line  is  called  a  "line  of  regression,”  and  it  represents  the  most  probable  linear  relationship  between  y 
and  X,  assuming  the  deviations  from  the  line  to  the  plotted  points  are  normally  distributed  (Panofsky  and  Brier, 
1976).  The  values  of  a  and  b  can  be  computed  as  statistics  from  a  sample  of  data  and  used  in  equations  to  predict  y. 

4.3  Application  of  Linear  Regression  to  Predictive  Equations.  The  SAS  procedure  REG  was  used  to 
compute  the  regression  coefficients  a  and  b  for  each  pair  of  variables  above.  The  dependent  dataset,  with  a  14-year 
POR  (1973-86)  was  used  to  find  the  regression  coefficients  in  each  case.  Values  for  a  and  b  were  inserted  into 
simple  linear  equations  of  the  form  of  equation  1  to  calculate  the  predictand  variable  based  on  the  predictor  variable. 

4.3.1  Root  Mean  Square  Error.  Root  mean  square  error  (RMSE)  is  a  measure  of  "badness"  of  the  fit  of  the  line 
of  regression  to  the  data  it  is  supposed  to  represent.  RMSE  is  a  measure  of  the  .scatter  of  the  points  about  the  line  of 
regression.  The  more  the  points  are  scattered,  the  greater  the  RMSE  and  the  worse  the  fit  of  the  line  to  the  data. 
RMSE  was  computed  for  each  of  the  above  cases  by  SAS  priKcdurc  REG,  and  is  included  in  Table  2. 

4.3.2  Variance.  Variance,  denoted  r^,  is  a  measure  of  the  "goodness"  of  fit  of  the  line  of  regression  with  respect  to 
the  observed  data,  or  how  well  the  prediction  equation  mirrors  reality.  We  arc  concerned  with  the  variance  of  the 
predictand— that  which  is  being  predicted.  Generally,  the  higher  the  value  of  r^,  the  better  the  equation  describes 
what  actually  happens  in  the  atmosphere.  A  value  of  variance  is  generally  thought  of  as  the  percent  of  the  variation 
seen  in  the  observed  values  of  the  predictand  that  can  be  explained  by  the  prediction  equation;  e  g.,  a  variance  of 
0.42  means  that  42  percent  of  the  variability  of  the  values  of  surface  wind  .speed  can  be  explained  by  the  equation 
predicting  wind  speed.  Values  of  variance  were  calculated  by  the  SAS  procedure  REG,  and  are  included  for  each 
case  in  Table  2. 

4.4  Heidke  Skill  Score.  Det  5  also  requested  a  Hcidke  skill  .score  (computed  using  a  dataset  independent  of  the 
one  used  to  compose  the  equations)  for  each  predictive  equation  developed.  Data  from  1987  and  1988  was  used  as 
this  independent  set.  The  method  for  computing  the  Heidke  .skill  score  is  de.scribed  in  AWS  TR  235,  Some 
Techniques  for  Deriving  Objective  Forecasting  Aids  and  Methods.  This  method  was  incorporated  into  SAS 
program  HEIDKE  written  at  USAFETAC/DNO  by  Maj  Walter  F.  Miller  and  used  to  compute  the  skill  .scores.  The 
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Heidke  skill  score  ranges  from  0  (no  forecasting  skill)  to  1.00  if  all  forecasts  verify.  The  scores  computed  for  each 
case  are  included  in  Table  1 . 

4.5  Predictive  Equations,  Statistics,  and  Skill  Scores.  Table  2  lists  the  predictand  and  predictor  variables 
that  Del  5  requested  we  study,  the  equation  developed  using  linear  regression  on  the  dependent  data  set,  the  values 
of  RMSE  and  variance  for  each,  and  the  Heidke  skill  score  for  the  equations  calculated  from  the  independent  data 
set. 

TABLE  2.  Variables,  Predictive  Equations,  Statistics,  and  Heidke  Skill  Scores  for  the  Three  Relationships 
Requested. 


Predictand 

(Dependent) 

Variable 

Predictor 

(Independent) 

Variable 

Predictive 

Heidke 

Skill 

y 

X 

Equation 

RMSE 

rj 

Score 

Max.  upper-air 
wind  speed 

BOI-GFA 
sea- level 

X2=  1.16*  x, +  18.21 

8.21 

0.26 

0.35 

8,0(K)  ft  MSL 

pressure 

difference 

Max.  hourly 
surface  wind 

BOI-GFA 

sea-level 

Xj  =  0.83  *  X,  +  5.88 

7.38 

0.19 

0.21 

speed  at 

Malmstrom  AFB 

pressure 

difference 

Max.  hourly 
surface  wind 

Max.  upper- 
air  wind 

X2  =  0.58  *  X,  +  0.32 

6.86 

0.42 

0.42 

speed  at 

Malmstrom  AFB 

speed  below 
8,(K)0  ft  MSL 

The  skill  scores  and  variances  rank  in  the  same  order  as  the  correlation  coefficients  for  each  .set  of  variables.  The 
equations  show  limited  skill  in  predicting  surface  and  maximum  upper-air  wind  speed. 

4.6  Chi-square.  It  is  possible  in  any  forecasting  scheme  that  skill  may  result  from  chance.  Sampling  error  alone 
makes  it  possible  for  a  forecasting  method  to  show  skill  on  either  the  dependent  or  independent  data  set.  It  is 
appropriate,  therefore,  to  test  if  forecast  skill  is  the  result  of  chance  alone.  To  make  that  test,  the  hypothesis  is  made 
that  the  predictive  equation  actually  has  no  skill  whatsoever.  The  chi-.square  test  evaluates  the  probability  that  this 
null  hypothesis— that  the  predictive  equation  actually  has  no  skill— is  true.  A  full  description  is  given  in  Panofsky 
and  Brier,  Some  Applications  of  Statistics  to  Meteorology,  1976.  The  value  of  the  chi-square  test  and  the 
probability  of  the  null  hypothesis  being  true  are  shown  in  Table  3. 
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TABLE  3.  Variables,  Equations,  and  the  Results  of  Chi-square  Tests  for  the  Three  Relationships  Requested. 


Predictand 

(Dependent) 

Variable 

Predictor 

(Independent) 

Variable 

Predictive 

Heidke 

Skill 

Chi-square 

Ho 

y 

X 

Equation 

Score 

Test 

Prob* 

Max.  upper- 
air  wind 

BOI-GFA 

sea-level 

X2=  1.16*x,  +  18.21 

0.35 

392.657 

0.00 

speed  below 

8,000  ft  MSL 

pressure 

difference 

Max.  hourly 
surface  wind 

BOI-GFA 

sea-level 

X2  =  0.83*x,  +  5.88 

0.21 

3172.036 

0.00 

speed  at 

Malmstrom  AFB 

pressure 

difference 

ilouiiy 

surface  wind 

Max.  upper- 
air  wind 

X2  =  0.58*x,  +0.32 

0.42 

434.061 

0.00 

speed  at 

Malmstrom  AFB 

speed  below 
8,000  ft  MSL 

*  Probability  that  the  null  hypothesis  (H^)  is  true. 


In  Table  3,  the  probability  that  the  null  hypothesis-the  predictive  equations  possess  no  skill  at  all-is  so  small  that 
the  SAS  routine  that  calculates  it  has  rounded  it  to  0.00  in  each  case.  The  low  probability  of  the  null  hypothesis 
being  true  supports  the  premise  that  the  equations  possess  skill,  and  suggests  the  improbability  of  successful 
forecasts  being  exclusively  due  to  chance. 
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5.  STEPWISE  REGRESSION. 


5.1  Improved  Skill  Scores.  Although  the  above  relationships  used  only  one  predictor  variable  and  showed 
some  skill,  the  skill  scores  were  low.  We  therefore  wanted  to  find  simple  relationships  that  were  more  skillful  at 
predicting  the  dependent  variables.  In  an  attempt  to  do  so,  a  stepwise  rcgrcssio.i  technique  was  used.  Stepwise 
regression  allows  several  independent  variables,  rather  than  just  one,  to  be  considered  as  candidate  predictors.  This 
technique  chooses  those  independent  variables  that  explain  a  significant  additional  amount  of  the  variance.  We  used 
the  SAS  procedure  REG  to  do  tliis,  with  the  STEPWISE  option. 

5.2.  Results.  Table  4  summarizes  the  outcome  of  the  stepwise  regression  procedures  used  to  improve  the  skill 
scores  for  predicting  the  dependent  variables.  Included  is  the  predictand  variable,  the  predictor  variables  selected  by 
stepwise  regression,  the  predictive  equation  used,  the  Heidke  skill  score,  and  results  of  the  chi-square  test.  As  for 
the  simple  regressions  above,  there  are  three  "situations"  for  which  equations  are  developed: 

•  Predicting  maximum  upper-air  wind  speed  below  8,(KX)  feet  MSL. 

•  Predicting  surface  wind  speed  based  on  predictors  excluding  upper-air  w  ind  speed. 

•  Predicting  surface  wind  speed  based  on  predictors  including  upper-air  wind  speed. 

The  differences  between  b  and  c  above  are  by  extension  ol  the  original  relationships  proposed  by  Det  5--surfacc 
pressure  difference  and  maximum  upper-air  wind  speed  below  8,(KX)  feet  MSL  were  used  individually  as  predictors 
of  surface  wind  sjx;cd  at  Malmstrom  (see  Table  3). 

Names  of  predictor  variable.s  .selected  by  stepwise  regrc.ssion; 

X|  =  hr  Hour  of  the  day  (Zulu) 

x^  =  hrmxkt  Hourly  maximum  wind  speed  at  Malmstrom  (knots) 

X3  =  boslp  Boise  .sea-level  pressure  (knots) 

X,,  =  pdiff  Sea-level  pressure  difference  between  Boise  and  Malmstrom 
X.;  =  show  Showalter  stability  index  at  Great  Falls  (dimensionless) 

Xf,  =  sweat  Severe  Weather  Threat  Index  at  Great  Falls  (dimensionless) 

x-j  =  maxdir  Direction  of  the  maximum  upper-air  wind  below  8,(KK)  feet  MSL  at  Great  Falls  (degrees) 

Xj  =  mxuakt  Speed  of  the  maximum  upper-air  wind  below  8,(K)()  feet  MSL  at  Great  Falls  (knots) 
x„  -  mxuakt3  The  cube  of  mxuakt  (knots’) 
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Names  of  the  predictand  variables  in  the  siluaiions  requested  in  the  SAR; 

y,  Predicted  speed  of  the  maximum  upper-air  wind  below  8, (XX)  feet  MSL  based  on  a  predictive 
equation  obtained  through  stepwise  regression. 

Predicted  surface  wind  speed  at  Malmsirom  AFB,  based  on  a  predictive  equation  obtained  through 
linear  regression.  This  equation  does  not  include  upper-air  wind  speed  variables  as  predictors. 

yj  Predicted  surface  wind  speed  at  Malm.strom  AFB,  ba.sed  on  a  predictive  equation  obtained  through 
linear  regression.  This  equation  does  include  upper-air  wind  speed  variables  as  predictors. 

The  predictands  y^  and  yj  both  are  for  predicted  surface  wind  speed  at  Malmstrom.  The  equation  for  y,  involves 
some  upper-air  wind  speed  predictors,  but  that  for  y^  does  not. 
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TABLE  4.  Results  of  Predictive  Equations  Developed 

Predictand  Predictor 

(Dependent)  Independent) 

Variable  Variables  Predic 


y,  X,  =hr 

Xj  =  bosip 
X4  =  pdiff 

X5  =  show 
Xg  =  sweat 

r^  =  0.46 

Heidke  skill  score  =  0.46 


Predictand 

(Dependent) 

Variable 


yi 


Predictor 

(Independent) 

Variables 


X,  =  hr 

X3  =  bosip 


X5  =  show 
x^  =  sweat 
X7  =  maxdir 


r^  =  0.31 

Heidke  skill  score  =  0.31 


Predictand 

(Dependent) 

Variable 


ys 


Predictor 

Independent) 

Variables 


X,  =  hr 
X4  =  pdiff 
x^  =  .sweat 

X7  =  maxdir 
Xg  =  mxuakt 
x,  =  mxuakt3 


r^  =  0.51 


Using  Stepwise  Regression. 


Predictive  Equation 


Heidke  skill  score  =  0.49 


y,  =  264.79  +  0.74»Xi  -  0.25*X3  +1.07*X4  + 
0.26*X5  +  0.51xs 


Chi-square:  117.008 
ProbofH/:  0.00 

Predictive  Equation 


y2=  138.82  -  0.9 l*x I  -0.13*X3+0.80*X4-t- 

0.22*X5  +  0.03*X6-t-0.01*X7 


Chi-square:  156.676 
ProbofH„*:  0.(X) 

Predictive  Equation 


yj  =  -0.23*x,  +  0.40*.X4  -t-  0.01  ^x^  -0.04*X7  ■ 
0.60*xg  -  .0(XX)42*x, 


Chi-square:  59.665 
ProbofH/:  0.001 


Probability  that  1 
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The  skill  score  of  the  predictions  was  larger  when  stepwise  regression  was  used  to  choose  the  best  predictor 
variables.  The  explained  variance,  r^,  was  also  increased  in  each  case,  meaning  more  of  the  variaiion  in  the 
predictand  could  be  explained  with  the  results  from  the  prediction  equations.  The  increase  in  skill  score  and 
variance  using  stepwise  regression  over  simple  regression  is  shown  more  closely  in  Figure  4. 


Heidke  skill  score/r^ 


Simple  Repression 

Stepwise  Regression 

Situation  1 

()..^5A).26 

0.46/0.46 

Situation  2 

0.21/0.19 

0.71/0.31 

Situation  3 

0.42/0.42 

0.49/0.  .31 

Figure  4.  Comparison  of  Heidke  skill  scores  and  variances. 


While  showing  improvement,  the  skill  scores  arc  still  somewhat  low  and  reflect  a  weak  relationship  between 
meteorological  variables.  This  is  evident  when  using  statistics  to  summarize  a  long  period  ol  meteorological  data. 
Statistical  results  are  derived  under  the  assumption  that  there  is  no  relationship  between  successive  pairs  of 
observations.  Weather  phenomena  usually  violate  this  assumption-occurrences  like  Chinook  w  inds  run  in  regimes, 
witfi  some  relationships  holding  at  some  times  and  different  relationships  holding  at  others  (Panofsky  and  Brier. 
1976). 
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6.  TIMING  FACTOR  STUDY. 

6.1  Overview.  None  of  the  rclaiionships  projxxsetl  by  the  customer  aikiressed  forccasiing  a  future  cvent-surfacc 
or  upper  wind  speecl--on  the  basis  of  current  data  To  consider  this,  the  customer  asked  us  to  examine  the  elapsed 
time  between  the  development  ol  u  lO-mh  pressure  difference  between  Boise  and  Malmsirom  and  the  onset  of 
25-knot  gusts  or  sustained  surface  wiiuls  at  Malmsirom.  The  customer  fell  that  if  there  was  a  particularly  favored 
lag  time,  it  could  be  included  in  an  equation  to  forecast  the  on.sct  of  gusty  v\  inds.  of  the  form: 

Onset  time  of  i^usty  wind  Constant  time  the  pressure  difference  increased  to  10  mh 

Del  5  also  asked  that  a  skill  sr  ore  bo  computed  for  this  equation  computed  against  an  independent  data  set. 

6.2  Method.  S.^S  .software  was  used  on  a  dependent  data  set  similar  to  that  described  alxtve,  except  that  the 
period  of  record  included  I^HlTiS  Before  B>81,  Malmsirom  AFB  reported  sea-level  pressure  only  every  ?>  hours. 
Since  a  liming  factor  was  now  being  investigated,  an  equal  distfibulion  of  pressure  observations  over  all  hours  was 
needed.  From  this  dataset,  each  observation  in  which  the  pressure  difference  between  Boise  and  Malmsirom  equaled 
10  mb  was  located.  The  first  instance  subsequent  to  this  time  that  a  25-knot  wind  speed  or  gust  was  ob.served  at 
Malmsirom  was  then  identified.  Clu'se  difierences  were  identified  as  "lag  times,"  which  were  grouped  into  bins  of 
1-hour  length-  lag  times  of  trom  0  to  1  hour  were  sorted  into  one  bin,  iho.se  from  I  I  to  2  hours  into  another,  etc. 
Lag  times  of  12  hours  or  more  were  grouped  into  their  own  bin.  The  SAS  prtKcdurc  FREQ  was  used  to  compute  the 
percent  frequency  of  occurrence  of  each  category  of  lag  lime. 

6.3  Results.  The  percent  frequency  of  (Kcurrence  of  lag  times  are  displayed  as  a  histogram  in  Figure  5.  As 
shown  in  the  figure,  there  is  no  favored  period  of  lime  between  the  two  events,  and  a  predictive  equation  could  not 
be  developed. 


Lag  Time  (hours) 

Figure  .5.  Distribution  of  lag  limes  between  the  occurrence  of  a  lO-mb  Boise-Malmstrom  pressure  difference  and 
the  onset  of  25-knot  gusts  or  sustained  winds  at  Malmstrom. 


7.  CONCLUSIONS. 


In  an  ullcmpl  lo  isolate  a  mechanism  causing  high  winds  at  Malmslrom  AFB  during  ChiniH)k  conditions, 
USAFETAC/DNO  investigated  correlations  between  the  three  sets  of  meteorological  variables  shown  below;  only 
weak  relationships  were  found. 

(1)  Maximum  upper-air  wind  speed  below  8,000  feet  MSL  and  a  sea-level  pressure  difference. 

(2)  Surface  wind  speed  and  sea-level  pressure  difference. 

(3)  Maximum  upper-air  wind  speed  below  8,000  feet  MSL  and  surface  wind  speed. 


U.sing  linear  regression  techniques,  predictive  equations  based  on  these  correlations  were  developed;  they  showed 
limited  skill. 

Next,  USAFETAC  attempted  to  improve  the  Heidke  skill  scores  by  including  more  predictor  variables  chosen  by  a 
stepwise  regression  technique.  Although  skill  scores  improved  somewhat,  they  remained  below  0.50. 

Finally,  we  looked  for  a  favored  time  interval  between  development  of  a  lO-mb  sca-lcvel  pressure  difference  and 
onset  of  25-knot  gusts  or  sustained  winds  at  Malmstrom.  There  was  none. 
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ABBREVIATIONS,  ACRONYMNS,  AND  SYMBOLS 


a 

AWS 

b 

BOI 

boslp 

DNO 

FREQ 

GFA 

Ho 

hr 

hrmxkt 

ID 

maxdir 

mb 

mxuakt 

mxuakt3 

MSL 

MT 

pdiff 

? 

REG 

RMSE 

SAS 

show 

sweat 

USAFETAC 

WW1-WW4 

Z 


A  coefficient  resulting  from  linear  regression 
Air  Weather  Service 

A  coefficient  resulting  from  linear  regression 

Station  identifier  for  Boise,  ID 

Variable  name  for  sea-level  pressure  at  Boise,  ID 

USAFETAC’s  Operations  Applications  Development  Section 

SAS  procedure  that  computes  percent  frequency  of  occurrence 

Station  identifier  for  Malmstrom  AFB,  MT 

Null  hypothesis 

hour 

Variable  name  for  maximum  hourly  wind  speed 
Idaho 

Variable  name  for  direction  of  maximum  wind  speed 
Millibar 

Variable  name  for  maximum  upper-air  wind  speed  below  8,000  feet  MSL,  in  knots 
Variable  name  for  the  cube  of  mxuakt 
mean  sea  level 
Montana 

Variable  name  for  sea-level  pressure  difference  between  Boise,  ID  and  Malmsuom  AFB,  MT 

Variable  name  for  variance 

SAS  procedure  for  linear  regression 

Root  mean  square  error 

Statistical  Analysis  System 

Variable  name  for  Showalter  Stability  Index 

Variable  name  for  Severe  Weather  Threat  Index 

USAF  Environmental  Technical  Applications  Center 

Present  weather  codes 

Zulu 
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Pacific  Missile  Test  Center,  Geophysics  Division,  Code  3253,  Pt  Mugu,  CA  93042-5000 . 
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Commander  and  Director,  U.S.  Army  CEETL,  Attn:  GL-AE,  Fort  Belvoir,  VA  22060-5546 . 

6510  TESTW/TSTL,  Edwards  AFB,  CA  93523-5000 . 

RL/DOVL,  Bldg  106,  Griffiss  AFB,  NY  13441-5700 . 

AFESC/RDXT,  Bldg  1120,  Stop  21,  Tyndall  AFB,  FL  32403-5(XX) . 

Technical  Library,  Dugway  Proving  Ground,  Dugway,  UT  84022-5000 . 

NWS  W/OSD,  Bldg  SSM  C-2  East- West  Hwy,  Silver  Spring,  MD  20910 . 

NWS  Training  Center,  617  Hardesty,  Kansas  City,  MO  64124 . 

NCDC  Library  (D542X2).  Federal  Building,  Asheville,  NC  28801-2723 . 

NIST  Pubs  Production,  Rm  A-405,  Admin  Bldg,  Gaithersburg,  MD  20899 . . 

JSOCAVeather,  P.O.  Box  70239,  Fort  Bragg,  NC  28307-5(XX) . 

75lli  RGR  (Attn:  SWO),  Ft  Benning,  GA  31905-5000 . 

NASA-MSFC-ES44,  Atm:  Dale  Johnson,  Huntsville,  AL  35812-5(XX) . 


DTIC-FDAC,  Cameron  Station,  Alexandria,  VA  22304-6145 . 2 

AUL/LSE,  Maxwell  AFB,  AL  361 12-5564 . 1 

AWSTL,  Scott  AFB,  IL  62225-5438 . 35 
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